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ABSTRACT 

Confirmatory factor analysis is a true statistical 
technique in the sense that it can test hypothesized relationships 
among variables. Unlike exploratory factor analysis, confirmatory 
factor analysis can be used to discbnfirtn or support a priori 
expectations about the target population based oh sample data. 
Confirmatory factor analysis can be combined with exploratory 
techniques in theory building. Such is the case in confirmatory 
factor extraction with subsequent relaxation of parameter constraints 
in stepwise fashion to determine the best model. Initial exploratory 
factor extraction can also be followed by cphfirmatbry factor 
rotation . Confirmatory factor extraction differs from" confirmatory 
factor rotation with respect to^t nature of the hypothesized 
relationships and the point at which the hypotheses are tested. 
Results of both confirmatory factor extraction and confirmatory, 
factor rotation must be inter^^ Assumptions of the 

techniques should not be violated ^ and magnitude of residuals should 
be_examined as an estimate of the extent to which the model is 
capitalizing on error variance. A hypothetical data set (scores of 50 
subjects on nine variables) is used to empirically demonstrate these 
methods • ( JAZ ) 
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Confiraatazy Factor Bztxaction 

versus 

ConfirBatory Factor Kotation 

Peggy C. Kir by 
University of New Orleans 

The m^t common applications Of factor analytic 
techniques in the behavioral sciences are exploratory 
methods wherein the number of factors and the 
relatiohships iunong variables are entirely determined 
by the data being analyzed (Nunhally, 1978). More 
recent confirmatory factor analytic techniques, on the 
other hand, are based oh a priori assumptions about 
characteristics of the population and seek to 
genera lisEe from sample data about the population 
parameters I3ar<e^kbg, .1969). 
I Ironically^ factor anaiysi^ was originally 

conceptualized as a confirmatory process. Spearman 
hypbtiiesized that all tests of mental abilities 
measured one general factor (G). By subtracting a 
matrix of cross-products of the structure coefficients 
■* of G frOTt the matrix of correlations, a residual matrix 
is obtaiMd irtiich can be examined to determine the 
tehability of the general factor hypoth^is. 
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it was quickly realized that Speafman*8 € factor 
methods wouldy in most cases, yield large residual 
coefficients and thus suggest a multifactor case. 
Subsequent techniques were based on the extraction of a 
genera?, factor and the examination of the residual 
matrix to determine additional factors. Since 
groupings were determined by the residuals rather than 
by hypothesized relationships. Spearman's factor 
analytic model, developed for hypothesis confirmation, 
became an exploratory technique (Nunnally, 1978)* 

in confirmatory factor analysis, the r^jearcher 
has a conceptual basis for hypothesizing patterns of 
relationships in the sample data. Hypbth^ized 
feiatiohships may involve the number of factors, the 
factor structure coefficients for some or all 
variables, or the correlations among factors^ 
Hypotheses nust have theoretical or empirical support. 
A series of exploratory factor analyses can eventtiaily 
yield enough evidence to suggest relationships that can 
be tested using confirmatory analysis. 
Confirmatory F actor Analysis 

Confirmatory factor extraction differs from 
confirmatory factor rotation (Thompson, 1986) with 
respect to the nature of the hypothesized relationships 

2 

4 

o 

ERIC 



and the point at which the fypotheses are tested. In 
confirmatory extraction^ the researcher may confirm or 
disconfirm conclusions regarding the hypothesized 
number of factors , the correlations among factors, of 
the correlations between variables and factors {i.e., 
structure coefficients). The three hypotheses are 
supported, respectively, by the magnitudes of the 
residuals, the inter-factor correlatibhs, and the 
magnitude of the structure coefficient of each variable 
on its predicted factor. 

Joreskdg (1969) developed a method of confirmatory 
factor extraction which applies a direct solution to 
the correlation matfixi Since confirmatory extraction 
is driven by hypothessized factor structure, the 
solution is directly interpret able. Rotation is not 
usufcilly required. Maxinum likelihood extraction 
employs a target matrix that identifies which 
population parameters are to be estimated. LISREL VI 
is a computerized mathematical package that performs 
maximam likelihood factor analysis and provides chi- 
squaf e estimates of the goodness of fit of the sample 
data to the hypothesized structure (Jbreskbg^ 1973). 

Thon^son (1986) suggests that several caveats and 
assumptions apply to confirmatory factor extraction 
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methods, it is assuxned that the data are miltivariate 
normally distributed although the procedures have been 
shown to be somewhat robust to violations of this 
assumption. In addition, a saSiple of at least 50 
replicates is requiredr perhaps more if there are a 
large number of factored entities, fts in ail 
statistical applicationsr it is assumed that the sample 
is repressentative of the population. Constraints 
placed on parameters mast have a strong theoretical 
basis. The methods are not readily applicable in the 
absence of rational eaqpectations regarding outcomes. 
Confirmatory Factor Rotation 

If confirmatory factor ertr action is not feasible^ 
factors may be extracted using one of the more common 
exploratory techniques and the resulting factor matrix 
rotated to a position of best fit with the hypothesized 
matrix. Kaiser, flunka, and Bianchini {1969} devised k : 
method of "relating" sets of factors. Two sets of 
factors obtained from different replicates are 
projected into the same space and the ccwihes of the 
angles among the factors across the two solutions are 
computed. The cosines are actually correlation 
coefficients since factora^ are standardized to unit 
length (Gorsuch, 1983). Similarly, a set of obtained 
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factors may be rotated to a position of best fit With a 
hypothesized target matrix (Ttompson, 1986). A 
computer program developed by Veidman (1967) to perform 
this rotation process is used in the sample analysis in 
the present study. 
Sample Aha i ysxs 

A simple hyE>6thetical data set was created to 
empirically demonstrate the processes of confirmatory 
factor extraction and confirmatory factor rotation. 
Scores of 50 subjects on nine variables are pr^ehted 
in Table 1. Assuming that there is adequate 
theoretical or empirical support for hypothesizing 
relationships among variables and assuming that the 
sample is representative of the population and is 
multivariate normal, the researcher may employ 
confirmatory factor analytic techniques. 

Table 2 presents the paramet^ specifications used 
in the example LISKEIi model. The researcher 
anticipates that the data are best ej^lained by three 
uhcorr elated factors with variables 1, 2, and 9 
correlating 6hly with Factor I; variables 3, A, and 5 
with Factor II? and variables 6, 7, and 8 with 
Frctor Ifi, The extraction process yields the directly 
ihterprcrtabie solution presented in Table 3. All 
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maximum likelihood estimates of the correlations 
between original variables arid their hypHDthi^ized 
factors exceed ,67 with t -ji exception of variable 2 
which has an estimated structure coefficient of 
on]y .26. Standard errors range from ,13 to ,29, with 
the variables hypothesized to constitute Factor i 
having the largest standard errors^ 

The chi-square goodness of fit test (Table 4j 
compares the model obtained under the imposed 
constraints to ah unconstrained models ft chi*-square 
value that is large relative to degrees of freedom 
indicates a poof model. The chi-sguare of 30.29 and 
adjusted goodness of fit index of .82 for this three- 
factor model can be compared to estimates of a 
l^pothesized two- factor model presented in Tables ^ 
and 6^. The two- factor model yields a statistically 
significant (e<.05) chi-sguare of 43.76 trith ah 
adjusted goodness of fit index of .74. 

In addition to the *<nf orinatioh presented above^ 
LISREL VI calculates modification indices which 
Jof eskog and Sorbom proposed as the decrease in chi- 
square to be es^ected if ai^ single parameter 
constraint is relaxed (Long, 1983). Modification 
indices for variables under the thfee-f actor model are 
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presented in Table ?• The most improvement in the 
model (i.e., iraost decrease in chi-sguarej would be 
obtained by releasing the constraint that variable 2 
have a zero correlation with factor 111. The 
modification index of 8.43 suggests a hbn-zero 
correlation. 

Relaxing parameter constraints one by one based on 
magnitude of modificatibh indices does become an 
exploratory rather than a cbhfifiatbry technique. The 
appropriate factor structure matrix is now being 
determined by the data rather than being derived from 
thfiory. Converse ly, cohfifmatbiy factor rotation 
begins with exploratory analysis of the data, 
proceeding to confirm hypothesized relationships only 
after factors are determined by the sample data. 

The raw data presented in Table 1 were subjected 
to -a principal components factor analysis with -varimax 
rotation. The rotated structure matrix is presented in 
Table 8. This matrix was rotated to a pbsitibh of best 
fit with the target matrix presented in Table 9 using 
Veldfflan*6 (1967) "KSLA^" progranu The target matrix 
specifies the same relationships hypothesized in the 
confirmatory extraction example. 

The projection of the two matrices ihtb the same 




factor space yields the structure matrix pr»ented in 
Table 10. Cosines of angles between factors of the two 
sets are included in Table 11. Diagonal entries 
indicate that correlations between like factors range 
frdin ,96 to 1.00 • These correlations appear to be 
statistically significant (£<.65) based on Thompson's 
(1986) partial test distribxation for factor cosines. 

While the ••relate* procedure is useful as an 
ihvariance technique and in instrument validation, it 
is criticized for its tendency to capitalize on 
sampling error (Nuhnaiiy, 1978? Thompson, 1986). The 
larger item-factor correlations produced by 
confirmatory rotation (Table 10) as compared to those 
resulting from confirmatory extraction (Table 3) 
support this criticism, although smaller structure 
coefficients would have resulted if principal factor 
analysis iiad been «nployed rather than principal 
components analysis. 
Summary 

Confirmatory factor analysis is a true statistical 
^ technique in the sense that it can test t^fpbthssized 

relationships among variables^ Though intuitively 
appealing to tiie novice researcher (Cronkhite ( liska, 
1980)^ exploratory factor analytic techniques are 
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criticized for their employioent "without due regard for 
the value of ... research proposals" (Sax, 1979, p. 
80). Unlike exploratory factor analysis, confirmatory 
factor analysis can be used to discbhfirih or support a 
priori expectations about the target population based 
on saittple data. 

Cbhfirihatbry factor analysis can be cbnibihed with 
explbratbry techniques in thebry building. Such is the 
case in cbnfirmatbry extraction with subsequent 
relaxation of parameter constraints in stepwise fashion 
tb determine the best robdei. initial explbratbry 
factor extractibn can alsb be followed by confirmatory 
rot at ibni 

Results of both confirmatory factor extraction and 
cbnfirmatbry factbr rotation must be interpreted with 
cautibh. ftssumptions of the techniques should not be 
vibiated, and magnitude of residuals should be examined 
as ah estimate of th^j extent to which the model is 
capitalizing on error variance. 
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Table 1 



Hyjsothetical Data Set (9 Variables/ 50 Replic^ites) 



114554332 
445452333 
235553111 
334542242 
224334543 
515554443 
223321344 
333543333 
153415313 
411124454 
2345554 53 
234543232 
234542122 
214544443 
125341111 
323324342 
131454442 



224545223 

235454452 

125353332 

335552233 

554541214 

445452323 

234451214 

244532223 

334453323 

224352322 

123454341 

454435453 

543224344 

324453232 

232412235 

231122124 

152 331211 



554453344 

334534544 

334345214 

434433233 

544543114 

443441315 

341122312 

242334212 

512225544 

352322133 

352212224 

453234244 

532125555 

234541113 

231221212 

323433533 
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Table 2 

Parameters To Be Estimated in LISREL 3 -Factor Model 



Variable Factor 1 Factor 2 Factor 3 

1 1 b 0 

2 2 0 0 

3 0 3 0 

4 0 4 6 

5 0 5 D 

6 0 0 6 

7 0 0 7 

8 0 0 8 

9 9 0 0 
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Table 3 

LISREL Fstlnates arifl .Stanrlard Errors 
3-Pactor Model 



LISRFL 


ESTIM/'TES (MAXIMUM tU^EtlHOOD) 




LAMBDA X 








FACTOP t 


FACI062 


FACTbe3 




0.837 


o:o 


0.0 


T2-2 


0.256 


0.0 


d.d 


D1-3 


d.d 


0.878 


0.0 


02-4 


Q.b 


0.756 


bo 


03-5 


0:0 


0:781 


o:o 




0.0 


0.0 


0.677 


P2-7 


0.0 


d.d 


0.813 


!^3-B 


0.0 


d.b 


b.804 


T3-9 


0.711 


0;0 


0.0 



STANDARD ERRORS 
LAMBDA X 









FACT0R3 


T1-1 


0. 29^1 


0.0 


0.0 


T2-2 


0. 1fi3 


0.0 


0.0 


bj-3 


0.0 


0. 127 


d.d 


D2-4 


d.d 


0. 131 


b.b 


D3-5 


b.b 


b. 130 


0:0 


P1-6 


0.0 


o:o 


0. 139 


P2-7 


0.0 


d.d 


d. 137 


P3-e 


d.o 


d.b 


0.137 


T3-9 


0. 261 


0.0 


0.0 



Table 4 



MEASURES OF GOODNESS OF FIT FDR THE IrfHOLE MODEL : 
CHI-SOUARE WITH 27 DEGREES OF FREEbOM IS 30.29 (PROB. LEVEL - 0.301) 

GOODNESS OF FIT |W)EX IS 0.890 
ADJUSTED GOODNESS OF FIT INDEX IS b.8l6 
ROOT MEAN SQUARE RESIDUAL IS 0.132 



Table 5 



Pararneter Specifications and Estlinater 
2-Pactor Model 

PARAMETER SPECIFICATIONS 
tAMBDA X 



t1-1 


1 


0 


T2-2 


2 


0 


D1-3 


0 


3 


D2-4 


0 


4 


03-5 


b 


5 


P1-6 


6 * 


b 


P2-7 


7 


0 


P3-B 


s 


d 


T3-9 


9 


0 



LISREL ESTIMATES (MAXIMUM LIKELIHOOD) 
LAMBDA X 

FACT0R1 F^GTOffS- 



Tl^i 0.260 00 

T2-2 -0356 0.0__ 

DJ-3 0.0 0.878 

D2-4 0.0 0.756 

D3-5 0.b__ b.7B1 

PI -6 b.665 b.b 

P2-7 0.829 00 

P3-8 0.800 0.0 

T3-9 0*213 0.0 



• I&ble 6 

MEASURES OF GOODNESS OF FIT FOR THF VHOLE MODEL : 
CHI-SOUARE WITH 27 DEGREES OF FREEDOM IS 43.76 (PROB. LEVEL » 0.022) 

GOboNESS OF FIT INDEX IS 0.84 1 
ADJUSTED GOODNESS OF FIT INDEX IS 0.736 
ROOT MEAN SQUARE RESIDUAL IS 0.134 
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Table 7 



Modification Indices 
3-Pactor Model 



MODIFICATION INDITES 

Lambda x 



Ti-i 

J2-2 
D1-3 

02- 4 

03- 5 
PI-6 
P2-7 
P3-8 
T3-9 



FACTOR < 
0.0 

d.d 

i . 457 

0:780 
2.2P2 

d.pes 

0.507 
0.475 
0.0 



F ACT0R2- 
1 . 105 
b.671 
0.0 
0.0 

d.d 

0.033 
O 473 
0.075 
4. 166 



f A CTORS 
2.249 
8.425 
0.057 
d.523 
0.009 
0.0 
0.0 

d.o 

0.314 
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Table 8 

VARIMAX Rotated Structure Matrix 



1 e, 16025 e. 

2-0.56698-6, 
? 0,10392-e, 
3 0,01345 0. 
1-0,C786O 0. 
S 0.04187 0. 

€ 0.71/105-0. 

7 0.85342-0. 
^ 0,84060-0. 



02654 e 
11555 0. 
22959 0. 
91025 0. 
84353-0 . 
85123-0. 
00918 0. 
08006 e. 
00134 0. 



.87773 
.47572. 
.81956 
.01817 
.07002 
21205 
05628 
13432 
14180 



Table 9 
Tar^cet Structure Matrix 



0.00000 
0.00000 

0 .00000 
0.00000, 

0 . 0000 0 ; 
f .000001 ' 

1 . 00000 
1 . 00000 



0.00000 
0.00000 

0. M000 
1 . 90000 

1. M000 
1 . 00000 

0 . 00000 

0 . 00000 



i .00000 

1.00000 
; 1.00000 
' 0 * 00 000 
! 0 • 00000 

e- AAAfltA 
*9 .90000 ^ 

0 . 00000 

eAAAAA 
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0 .3146 
-0.4483 
6 .2652 
-0 .0377 
-0 .1383 
-0 .04 97 
0 .7 499 
0 .8475 
0 .8319 



Table 10 
Rotated Factor 
CO 2 43 
-0.0 908 
-0.2385 
0 i 9347 
0i8702 
0.8720 
-0 .0454 
-0.1219 
d .0404 



Matrix 

6.8510 
0.5390 
0.8060 
-0.0055 
-b .0808 
-b .2356 
-0 .0320 
b .0376 
0.0446 
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Table 11 



Cosines of Angles Between Factors 

1 2 3 

1 0.96 -0 .06 0 .19 

2 -0.05 l.Ob 0.00 

3 -b.ll ^.02 C.99 
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